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1-  INTRODUCTION 


V 


A  theoretical  method  for  defining  texture  measures  was 


N  Y 

defined  bg  Conners  and  Vasquez  Cl.  23.  The  use  of  this  method 
requires  a  perceptual  ranking  which  can  be  used  to'  rank  the 
relative  visual  ,  differences  among  a  set  of  texture  pairs. 
This  report  describes  the  theoretical  development  and  an 
implementation  of  such  a  perceptual  ranking.  This  perceptual 
ranking  is  called  the  law  of  comparative  judgment^tLCJ)!  It 
was  developed  bg  Thurstone  It  allows  n  things  to  be 

ranked  (scaled)  based  on  pairwise  responses  obtained  over  all 
possible  combinations  of  n  things  taken  two  at  a  time.  ^ _ _ _ 


The  n  things  to  be  ranked  in  the  measurement  definition 
problem  are  n  texture  pairs.  The  scaling  determines  the 
relative  discriminabilitg  of  the  pairs,  i. e. ,  which  pair  is 
the  most  visuallg  distinct,  which  is  the  next  most  visuallg 
distinct,  etc.  The  pairwise  responses  are  experimental  data 
obtained  bg  showing  subjects  two  texture  pairs  at  a  time. 

Each  subject  is  asked  to  independently  give  his  opinion  as  to 

»'• 

which  of  the  two  is  the  more  visuallg  distinct  texture  pair. 


In  what  follows,  a  background  on  perceptual  ranking  will 
be  given  and  the  reasons  for  selecting  the  LCJ  will  be 
presented.  Then  a  theoretical  development  of  the  LCJ  is 
given  in  sections  3  and  4  which  develops  the  mathematical 


equations  necessary  to  implement  the  method, 
for  the  software  based  there  mathematical 
presented  in  section  5.  Finally  in  section  6 
runs  are  given. 


Documentation 
equations  are 
some  samples 


2. -BACKGROUND 


For  the  measurement  definition  problem*  A;  perceptual 
ranking  (scaling)  is  neccesary.  A  psycholog ical  ~ experiment 
has  to  be  performed  in  order  of  obtain  this  scaling.  This 
section  presents  a  brief  description  on  psychological  scaling 
methods  Psychological  scaling  methods  are  procedures  for 
constructing  scales  for  the  measurement  of  psychological 
attributes. 

The  measurement  of  observers'  responses  to  stimuli  grew 
up  in  what  is  called  psychophysics.  Psychophysics  was 
defined  by  Gustav  Theodor  Fechner  as  "an  exact  science  of  the 
functional  relations  of  dependency  between  body  and  mind." 
C43  As  developed  by  Fechner  C53.  psychophysics  includes  both 
the  measurement  of  sensory  attributes  and  the  quantif ication 
of  perception*  in  order  to  correlate  these  psychological 
scales  with  physical  measurements  of  the  stimuli.  He 
suggested  that  the  sensation  intensity  was  proportional  to 
the  logarithm  of  the  stimulus  intensity. 

L.  L.  Thurstone  C33  pointed  out  that  there  were  two 
classes  of  psychophysical  methods.  One  class  required  that 
the  experimenter  be  able  to  obtain  some  physical  measurement 
of  the  stimulus*  and  to  control  this  measurement  for  purposes 
of  his  experiment.  Examples  of  this  class  are  the  method  of 


average  error  and  the  method  of  minimial  changes  C63.  A 
second  class  could  be  readily  applied  in  cases  where  precise 
measurement  and  controlled  variation  of  the  physical 
characteristics  of  the  stimuli  were  not  posible.  ~  The  method 
of  paired  comparisons  is  a  second  class  example, 

/ 

In  his  overview  of  psychophysical  scaling  methods*  F. 

Novell  Jones  C73  divided  the  psychophysical  scaling  in  two 

methods:  the  direct  methods  and  the  indirect  methods.  The 

direct  methods  requires  that  judgments  be  made  either 

according  to  some  predetermined  ratio  given  by  the 

experimenter*  or  made  in  terms  of  real  numbers.  Thus  the 

data  collection  involves  a  judgment  in  terms  of  a  scale 

external  to  the  stimuli  themselves.  Example  of  methods  that 

belong  to  this  group  are  methods  involving  judgment  of 

assigned  intervals*  fractionation  methods*  methods  of 

multiple  production  or  multiple  judgments*  the  constant  sum 

or  ratio  partition  method*  and  magnitud  estimation.  The 

"indirect*"  or  Fechnerian  methods*  seem  to  be  so  called 

because  considerable  statistical  manipulation  is  required  for 
\  • 

the  constructions  of  a  measurement  scale.  Actually*  data 
collection  is  "direct"  for  these  methods*  because  what  is 
required  is  direct  judgments  of  differences  among  stimuli. 
Methods  that  belong  to  this  group  are  The  law  of  comparative 
judgments  and  categorical  judgments.  The  best  method  for  our 
perceptual  scaling  belongs  to  the  indirect  method  because  the 


needs  of  direct  judgments  of  differences  among  texture  pairs 
(stimuli).  For  this  reason*  let  discuss  or  describes  the 
indirect  methods.  For  the  description  of  the  different 
methods  for  the  direct  case  and  also  indirect'  cases  the 
reader  can  be  referred  to  the  following  references  £4*6-133. 

/ 

The  original  Fechnerian  idea  was  based  on  what  he  called 
Weber's  law  £53.  That  is*  if  discrimination  requires  a 
constant  proportional  increase  in  the  stimulus*  a  function 
dr/R=k«  mag  be  written  for  some  probability  of 
discrimination*  and  if  one  assume  that  this  relationship 
holds  for  very  small  increments*  one  may  regard  this  formula 
as  giving  the  relationship  between  the  stimulus  and 
subjective  increment.  This  leads  to  the  statement  that  S=K 
log  R.  Now*  if  what  one  needs  is  the  Weber  fraction  <k).  and 
if  one  assumes  that  it  is  constant  over  a  long  range  of 
stimuli*  any  psychophysical  method  that  yields  a  measure  of 
discrimination  will  give  us  a  subjective  scale.  In  practice* 
this  is  not  done.  The  above  is  known  as  classical 
psychophysic  method.  The  law  of  comparative  judgment  belongs 
to  a  group  of  methods  known  as  psychological-scaling.  It 
differs  from  the  traditional  or  classical  psychophysical 
method  in  that  at  the  end  results  are  no  values  on  physical 
scales  but  are  on  psychological  scale. 


Modem  work  on  indirect  scaling  was  begun  by  Thurstone 


with  the  publication  of  the  LCJ.  The  idea  was  that  a 
stimulus  -  whether  physical  or  otherwise-  gives  rise  to  a 
hypothetical  discriminal  process  within  the  subject  which* 
for  various  random  reason*  varies  from  presentation  to 
presentation  of  the  same  stimulus.  The  LCJ  can  be  considered 
as  a  probabilistic  model.  This  model  assumes  that  the  scale 
positions  belonging  to  the  psychological  objects  are 
themselves  stochastic.  Then  the  scale  position  does  not  have 
a  fixed  value  but  is  regarded  as  a  stochastic  or  random 
variable  with  an  associated  probability  density  function.  An 
assumption  is  needed  to  form  the  density  function.  A  popular 
assumption  is  that  the  scale  positions  are  normally 
distributed. 

The  most  usual  method  of  obtaining  data  for  use  in 
scaling  according  to  the  LCJ  is  by  means  of  pair  comparisons. 
The  main  advantage  of  the  method  of  pair  comparisons  is  that 
it  yields  an  estimate  of  subjective  distance  over  the  range 
of  whatever  stimuli  are  used.  Xt  is  possible  to  use  stimuli 
that  cannot  be  arranged  on  an  objective  dimension.  One  need 

l  • 

not  know  in  advance  which  stimuli  lie  next  to  each  other 
subjectively.  There  are  two  main  disadvantages.  First* 
there  must  be  some  degree  of  confunsion  between  adjacent 
stimuli  since*  if  not*  we  have  seen  that  no  estimate  of 
distance  is  possible.  The  second  disadvantage  is  that  the 
method  requires  a  good  many  judgments  for  the  amount  of 


information  extracted.  Other  scaling  method  has  been 
developed  using  the  method  of  paired  comparison  or  a 
variation  of  the  method  to  try  to  overcome  :  the  above 
disadvantage.  But  all  of  these  methods  are  very  ^restrictive 
to  be  used  in  our  definition  problems.  These  methods  are  the 
composite  standard  £133  and  the  proposed  by  Guttman  £143. 

The  other  method  for  collection  of  data  for  comparative 

judgment  is  the  method  of  rank  order.  In  this  method)  the 

subject  is  asked  to  arrange  a  set  of  stimuli  in  accordance 

with  the  amount  of  some  property.  This  method  differs 

psychologically  from  the  pairs  comparisons  in  the  stimuli  are 

all  presented  at  the  same  time  and  hence  the  judgment  are 

made  in  the  context  of  the  total  range/  whereas  the  total 

range  enters  into  pair  comparisons  only  by  way  of  some  memory 

process.  To  derive*  a  scale  from  rank  data  is  ordinarily 

accomplished  in  one  of  two  ways.  The  first  assume  that  the 

stimuli  were  drawn  from  a  population  of  stimuli  that  is 

normally  distributed  with  respect  ti  the  property  of 

interest.  The  second  method  is  derived  from  the  LCJ  £133. 

>  • 

The  advantage  of  this  method  is  less  time  consuming  that  the 
method  of  pair  comparison.  The  method  of  categorical 
judgment  was  developed  by  Togarson  £43.  The  subject  is 

pvesented  with  a  succession  of  stimuli  that  he  is  to  place  in 

appropiate  category*  where  the  experimenter  has  determined 
the  number  of  categories  to  be  used.  This  method  is  no 


appropriated  for  our  experiment. 


Of  all  the  techniques  mentioned/  the  best  technique  that 
seems  suitable  for  our  experiment  purpose  is  the^  LCJ.  The 
data  collection  will  follow  the  method  of  paired  comparison. 
The  LCJ  is  applicable  not  only  to  the  comparison  of  physical 
stimuli  intensities  but  also  to  qualitative  comparative 
judgment  such  as  those  of  excellence  of  specimens  in  an 

r 

educational  scale#  and  it  has  been  applied  in  the  measurement 
of  such  psychological  values  as  a  series  of  opinions  on 
disputed  public  issues.  Also#  it  has  been  used  for  scaling 
social  values/  nationality  preferences.  temperature- 
moisture.  the  lif ted-weight  experiment,  etc.  More  recently 
this  law  was  used  by  Tamura  et  al.  C153  to  construct  a 
psychometric  prototypes  with  which  the  measures  computed  from 
a  set  of  texture  could  be  compared.  In  the  next  section,  a 
complete  discussion  on  the  LCJ  is  given. 


3.  -THE  LAW  OF  COMPARATIVE  JUDGMENT  (LCJ) 
A.  The  Psychological  Theory 


.Thurston*  C3J  postulates  an  one-^dimensional 
psychological  scale  onto  which  stimuli  (texture  pairs)  are 
mapped.  The  nature  of  this  scale  is  left  unspecified:  it 
may  be  psychic*  physiological  or  both.  The  concepts  is  as 
follow:  each  time  a  stimulus  (texture  pairs)  is  presented  it 
is  presumed  to  be  represented  by  a  point  along  the 
psychological  scale.  The  location  of  the  point  is  determined 
by  an  unknown  discriminal  process  by  which  the  organism 
identifies.  distinguishes.  discriminates.  or  reacts  to 
stimuli.  Because  of  the  uncertain  nature  of  a  person's 
perceptual  state.  the  same  stimulus  does  not  always  excite 
the  same  discriminal  process.  It  is  assumed  that  repeated 
occurrences  of  a  stimulus  produce  a  distribution  called  a 
discriminal  dispersion  of  such  processes  along  the 

e 

psychological  scale.  A  normal  distribution  is  usually 
assumed.  These  random  events  will  tend  to  describe  a  normal 
distribution  around  a  mean.  The  mean  is  associated  with  the 
scale  value  of  the  stimulus,  and  the  standard  deviation  is 
interpreted  as  the  unit  of  measurement  along  the  internal 
scale. 

For  convenience.  Thurstone  represented  each  stimulus  on 
a  hypothetical  psychological  continuum  by  tha  single 


discriminal  process  corresponding  to  the  mean  of  its 
discriminal  dispersion.  By  using  the  standard  deviation  of 
the  discriminal  dispersions  as  units  of  measurei  scale  value 
arc  then  established.  Thus  the  means  of  the : d iscr iminal 
dispersions  are  the  scale  values  measured  on  an  interval 
scale  in  units  of  standard  deviation.  Pairs  of  stimuli  are 
represented  for  judgment  to  obtain  an  empirical  estimates  of 
the  distance  along  the  psychological  scale  separating  each 
stimulus  from  every  other  one. 

Lets  consider  the  theroretical  distribution  of 
discriminal  processes  for  any  two  stimulus  j  and  k  as  show  in 
figure  1.  These  stimuli  are  associated  on  the  psychological 
scale  with  theirs  respective  normal  discriminal  dispersion 
with  means  uk  and  uj  and  standard  deviation  (fk  and  <f j. 


STIMULUS 

Figure  1.  Discriminal  dispersion  for  stimuli  j  and  k. 

The  means  of  the  hypothetical  distributions 
'  are  and  with  standard  deviation 


If  the  two  stimulus  were  presented  together  to  an  observer  on 
a  large  number  of  occasions,  each  would  excite  a  discriminal 
process  on  each  presentation.  i. e. »  a  point  along  the  scale. 
These  two  discriminal  proceses  are  compared.?  On  those 
occasion  when  the  process  associated  with  k  is  greater  than 
the  process  for,  j  the  observed  will  judge  k  to  be  greater 
than  j.  an  vice  versa.  Since  the  two  distributions  are 
normal,  no  value  for  a  process  is  impossible.  The  two 
distribution  will  overlap,  and  theoretically  a  stimulus  will 
not  be  judged  greater  than  another  on  100%  of.  the  trials.  In 
figure  1.  it  is  clear  that  k  will  be  judged  greater  than  j  on 
most  occasions  since  most  of  the  distribution  for  k  has 
higher  values  that  the  one  for  j.  But  assuming  random 
sampling  from  each  distribution,  we  can  expect  a  reversal 
once  in  a  while  (j  >  k). 

In  the  analysis  of  stimulus  pairs,  one  does  not  directly 
measure  the  variance  and  means  of  individual  discriminal 
dispersions.  Instead,  one  is  receiving  information  on  the 
distribution  generated  by  all  possible  pairs  of  processes 
selected  from  the  two  discriminal  dispersions.  One  needs  to 
have  the  appropriate  assumptions  in  which  the  information  on 
the  individual  dispersions  is  directly  translated  into 
information  on  the  distribution  of  differences  and  vice 


versa. 


Figure  2  shows  the  distribution  associated  with  four 


stumuli:  1»2#3»  and  4.  The  scale  value  for  stimulus  1  is 

ui#  of  stimulus  2  is  u2»etc. 


1  8.  The  Law  of  Comparative  Judgment 

One  wishes  to  estimate  the  distance  between  stimuli  and 
use  this  information  to  locate  the  stimuli  relative  to  each 
other  along  one  dimensional  psychological  scale.  Lets  assume 
that  each  pair  is  associated  with  a  single  hypothetical 
distribution  of  differences  generated  by  pairing  all  possible 


discriminal  processes  in  j  with  all  discriminal  processes  in 
k.  Therefore/  the  subject  uses  the  differences  in  the 
magnitude  of  discriminal  processes  to  make  4  decision 
concerning  the  dominance  of  one  stimulus  over  another.  From 

-  statistics/  the  difference  between  the  means  of  two  normal 

r 

-  distribution  is  /equal  to  the  mean  of  their  differences. 

Then>  to  find  the  differences  in  scale  values  for  two 
stimulus  (k  and  j)/  the  mean  of  their  distribution  of 
differences  has  to  be  found.  This  mean  can  be  measured 
arbitrarily  from  a  point  representing  those  cases  where  the 
difference  between  two  discriminal  processes/  one  for  each 
stimulus/  is  0.  Lets  locate#  for  convenience/  the  zero  point 
as  the  mean  discriminal  process  for  the  stimulus  j.  i.  e.  # 
this  transf ormation  may  be  done  by  substrating  the  original 
mean  uj  from  all  discriminal  process  in  both  distribution. 
Then  the  mean  of  the  discriminal  dispersion  of  j  is  now  zero 
(uj  -  uj  »  0)/  and  the  mean  of  the  discriminal  dispersion  of 
k  is  now  uk  -  uj.  This  value  is  also  the  mean  of  the 

difference  between  all  possible  discriminal  dispersions.  To 
prove  this  recall  the  new  distribution  was  created  by  taking 
differences  between  pairs  of  discriminal  process#  one  from 
each  of  the  discriminal  dispersions. 


Let  pick  a  discriminal  process  with  a  value  s  from 
distribution  k  and  calculate  the  mean  difference  between  s 
and  all  discriminal  processes  in  j.  This  average  will  be  s< 


since  the  discriminal  dispersion  of  j  is  symmetric  around  0. 
That  i s<  for  every  discriminal  process  with  value  x  there  is 
one  with  value  ~x  with  the  same  density  defined  by  the 
discriminal  dispersion  of  j*  and  their  effects  cancel.  If 
one  repeats  this  procedure  for  all  discriminal  processes  in 
k  produces*  a  symmetric  distribution  around  uk  -  uj  will 
result.  Then  the  mean  of  the  difference  of  the  discriminal 
dispersion  is  uk  -  uj. 

r 

Figure  3  presents  a  hypothetical  distribution  of 
differences*  with  a  mean  uk  -  uj  and  a  standard  deviation 
The  shaded  area  in  the  figure  J3  indicates  the 
proportion  of  times  the  difference  dk  -  dj  was  positive*  and 
the  unshaded  area  indicates  the  proportion  of  time  dk  -  dj 
was  negative.  di  is  an  arbitrary  discriminal  process  for 
stimuli  i. 


Figure  3.  Hypothetical  normal  distribution  of 
differences  between  discriminal 
processes  <dK  -  dj  ) .  Data  obtained 
by  pairing  stimuli  j  and  k  on  many 
occasions. 


The  normal  density  function  may  be  defined  by  the 


equation: 


l  exP 

fan  5* 


The  total  area  under  the  curve  is  1.  By  integrating  equation 
1  the  area  under,  any  section  of  the  curve  may  be  determined. 


Pto  -  -J—  fexP  [-  ■■  ^-'9-] 
a-  J  L  2ir2  J 

The  distribution  function  can  not  be  expressed  in  closed  form 
in  terms  of  elementary  functions.  The  distribution  function 
is  usually  tabulated  for  a  normal  random  variable  that  has  a 
mean  value  of  zero  and  a  variance  of  unity  (standard  normal 
distribution).  It  is  often  designated  by  j|(x>  and  is  defined 

4W*  [- %]%  (*) 

By  converting  the  probability  with  which  k  >  j  (shaded  area 
on  figure  2)  into  a  cumulative  standard  normal  distribution* 
one  obtains  a  standarlized  measure  of  the  difference  between 
discriminal  processes  <uk  -  wj).  Therefore* 

*  4*.  -Ui  M) 

Okj 

where  it  the  standard  deviation  of  the  difforoncat  of 
stimulus  pair.  The  standard  deviation  of  the  difference 
between  two  normal  distribution  is 

Cij  =  + 


(5) 


where  rjk  is  the  correlation  coefficient.  For  the  derivation 
of  equation  5  see  appendix  A.  Rearranging  equation  4 

Uk-Uj  5IKy(TH  t 

substituting  equation  5  into  equation  6*  one  obtain 
Thurstone's  complete  law  of  comparative  judgment 

Uk  -Uj  ( trJW/-  c-7) 

where  uk  and  uj  are  the  mean  value  for  stimuli  k  and  j 

respectively.  4k  and  <fj  are  the  standard  deviation  for 
stimuli  k  and  j.  rkj  is  the  correlation  coefficient  between 
stimluli  k  and  j.  Zkj  is  the  normal  deviate  corresponding  to 
tha  theoretical  proportion  of  time  stimulus  k  is  judged 
greater  than  stimulus  j. 

The  LCJ  is  not  solvable  in  its  complete  form.  since* 
regardless  of  the  number  of  stimuli*  there  'are  always*  more 
unknowns  than  observation  equations.  For  examples*  with  n 

stimuli*  there  are  n  scale  values*  n  standard  deviation*  and 
n(n-i>/2  independent  correlation  which  are  unknown.  The  xero 

t  • 

point  of  the  scale  can  be  set  arbitrarily  at  the  scale  value 

of  one  stimulus*  and  the  unit  can  be  taken  as  one  of  the 

standard  deviation*  leaving  2(n-l>  +  n(n-l)/2  unknowns. 

Against  this  we  have  only  n<n-l)/2  observation  equations  - 
one  for  each  independently  observable  proportion.  The  number 
of  equations  is  always  2(n~l)  less  than  the  number  of 


unknowns.  Simplifying  hypotheses  are  thus  necessary  in  order 
to  make  the  law  workable. 

i 

r 

Thurstone  C33  presented  five  cases  of  the  LCJ.  In  case 
1»  the  complete  form  of  the  LCJ  can  be  used  making  at  least 
one  assumption.  /  The  correlation  between  discriminal 
deviation  is  practically  constant  throughout  the  stimulus 
series  and  for  single  observer.  Case  2  is  the  same  as  case 
1.  The  only  difference  is  the  use  of  several  observers. 
Case  3»  case  4*  and  case  S  denote  three  special  sets  of 
equations  obtained  from  various  simplifying  assumptions.  For 
the  measurement  definition  probiemi  case  4  of  the  LCJ  was 
implemented  (see  next  section).  Lets  now  present  the 
approach  followed  by  Thurstone  C33  to  develop  case  4. 

In  case  4#  Thurstone  assumes  the  correlation  coefficient 
is  equal  to  zero  and  the  standard  deviation  is  not  subject  to 
gross  variation.  With  those  assumptions!  the  complete  form 
of  the  LCJ  can  be  simplified  so  that  it  becomes  linear.  If 
the  correlation  coefficient  is  tero  (r  **  0)>  using  equation 
7*  the  law  takes  the  following  form 

Uk  -Uj  =  l* j  (<r<?  )'k  (8) 

Assume  that 

(1) 


in  which  d  is  assume  to  be  smaller  than  £j.  Equation  8 


becomes 

Uk  -  Uj  « I«i  ( Cffj  U?  +q1/*  J 

=  ( <^2+  M  +av^ 

z 

The  term  d~  may  be  dropped  if  d  is  small. 

^-U-i  =  Z*(<r*+2di<U<Ti!)//2 

*  ?*j  (<i  *h/4  Co) 

Let  expand  the  term  <@j  +  d>l/2  in  equation  10  »  and  lets  use 
the  first  two  terms. 


-7«iOfir«i +4|ii]  00 


Rewriting  equation  9  as  follow 


d 


) 


Substituting  equation  12  in  equation  11«  one  obtains 

UK  -  Hi  --  iv-i  +(<rK-<r^|6] 

-  [^|/2  4  ^  I^J 


(>2) 


03) 


Equation  13  is  the  case  4  of  the  LCJ. 

In  C43#  Torgerson  found  an  approximating  equation  for 
the  LCJ  that  is  formally  identically  with  the  equation  13. 
He  assumed  that  the  c  correlation  coefficient  are  all  equal 
and  the  difference  between  standard  deviation  are  small.  The 
equation  is  as  follows; 

U*  -  Uj  ( (\ -to/ay4  (<rK  (l+) 

He  demonstrated  that  the  assumption  of  r-0  was  unnecessarily 
restricting.  One  needs  only  to  assume  that  the  correlation 
are  all  equal.  For  the  demotration  of  equation  14  the  reader 
is  referred  to  reference  4. 

C.  -  The  Method  of  Paired  Comparisons 

The  law  of  comparative  judgment  assume  that  each 
stimulus  has  been  compared  with  each  other  stimulus  a  large 
number  of  times.  Hence#  the  law  requires  that  data  of  the 

i 

form  “the  proportion  of  times  any  stimulus  k  is  judged 
greater  than  any  other  stimulus  j“  are  available.  The  direct 
method  for  obtaining  empirical  estimates  of  these  proportions 
is  known  as  the  method  of  paired  comparisons.  This  method  is 
essentially  a  generalisation  of  the  two-category  case  of  the 
method  of  constant  stimuli#  where  in  the  method  of  constant 
stimuli#  each  stimulus  is  compared  with  a  single  standard  and 
in  paired  comparisons  each  stimulus  serves  # in  turn#  as  the 


standard.  In  paired  comparisons*  each  stimulus  is  paired 
with  each  other*  that  means  that  with  n  stimuli  there  are 
thus  n(n-l)/2  pairs.  Each  pair  is  presented  to  the  subject, 
whose  task  is  to  indicate  which  member  of  the  pair  appears 
greater  with  respect  to  the  attribute  to  be  scaled.  The 
subject  must  designate  one  of  the  pair  as  greater*  and  no 
subject  must  designate  one  of  the  pair  as  greater*  and  no 
equality  judgments  are  allowed.  This  is  consistent  with  the 
derivation  of  the  law  *  wherein  the  probability  of  a  zero 
discriminal  differences  is  vanishingly  small. 

To  obtain  data  from  which  the  proportion  may  be 
estimated*  a  large  number  of  comparison  have  to  be  made  for 
each  pair  of  stimuli.  There  exist  three  alternatives  where 
the  necessary  replication  might  be  obtained: 

1.  having  a  single  subject  judge  each  pair  a  large 
number  of  times* 

2.  many  subjects  each  judge  each  pair  once*  or 

3.  several  subjects  each  judge  each  pair  several 
times. 

The  choice  of  these  alternatives  will  may  depend  on  the 
purpose  of  the  experiment*  the  extent  of  individual 
differences*  and  the  nature  of  the  stimuli. 

Caution  has  to  be  taken  in  order  to  use  either  the  first 
or  third  alternative  that  the  stimuli  should  be  such  that  no 


extraneous  differentiation  cues  are  available  to  the  subject. 
If  the  subject  can  identify  the  stimulus  pairs>  there  is  the 
possibility  that  he  will  base  his  later  judgments  on  his 
memory  of  his  earlier  judgments  of  the  pair. 

In  the  law  of  comparative  judgment*  no  explicit 
provision  is  made  for  time  or  space  errors.  Nor  is  there 
provision  for  changes  in  performance  due  to  fatigue  or 
practice  effects*  or  for  judgments  based  in  poart  on  factors 
other  than  the  relative  magnitudes  of  the  discriminal 
processes.  Then*  it  is  necessary  to  control  experimentally 
the  conditions  that  might  introduce  these  biasing  effects. 
Most  of  these  factors  can  be  controlled  in  the  assignment  of 
the  relative  positions  (spatial  or  temporal)  of  the  members 
of  each  stimulus  pair  and  the  order  of  presentation  of  the 
pair  themselves.  An  experiment  can  be  controlled  by 
randomi zation  of  relative  positions  and  of  orders.  This 
method  is  not  the  most  efficient  one.  More  efficient  methods 
use  counterbalanc  ing  procedures.  For  example*  time  (or 

space)  errors  can  be  controlled  by  arranging  the  members  of 

\' 

the  pairs  so  that  half  the  time  each  stimulus  appears  first 
(or  to  the  left*  below*  etc.  )  and  half  the  time  second  (to 
the  right*  above*  etc. ).  Perhaps*  the  best  procedure  is  to 
counterbalance  each  pair  of  stimuli:  e. g. ,  with  stimulus 
pair  j*  it*  present  j  first  half  the  time*  it  first  the  other 
half.  Practice  or  fatigue  effects  can  be  controlled  by 


reversing  the  order  of  presentation  of  the  pairs  for  half  of 
the  subject  (or  trial*). 

In  £43*  Togerson  presents  a  list  of  .  additional 
precaution*  some  of  which  may  or  may  not  be  relevant  for  any 
given  experiment./  These  additional  precaution  are: 

1.  Keeping  pairs  having  one  stimulus  in  common 
maximally  separated  in  the  order  of  presentation. 

2.  Arranging  pairs  so  that  "correct"  responses  are 
approximately  evenly  divided  between  first  and 
second  memebers  of  the  pairs. 

3.  Arranging  pairs  so  that  there  is  no  detectable 
systematic  pattern  of  "correct"  responses. 

4.  Arranging  pairs  so  that  there  is  no  systematic 
variation  in  difficulty  of  judgment. 

3.  Varying  the  order  of  presentation  from  trial  to 
trial  to  eliminate  serial  learning  of  a  response 
pattern. 

Ross  £173  gives  a  table  of  the  balanced  optimal  orders 
%• 

for  odd  numbers  of  members  from  five  to  seventeen.  Also*  he 
presented  his  general  method  for  calculating  orders  of 
presentation.  His  orders  are  optimal  in  the  sense  that  c) 
each  stimulus  appears  first  in  half  the  pairs  of  which  it  is 
a  member*  blpairs  having  one  stimulus  in  common  are  maximally 
separated  in  the  order  of  presentation*  and  c)  there  is  no 


detectable  pattern  of  “correct"  responses.  His  orders  have 
the  following  advantages: 

1.  They  maintain  the  greatest  possible  spacing 
between  pairs  involving  identical  members. 

2.  They  are  so  balanced  as  to  remove  time  and 
space  erros. 

3.  They  avoid  regular  repetitions  which  might 
have  suggestion  effects. 

4.  By  repeating  the  series  in  reverse  order 
fatigue  effects  may  be  balanced  out. 

5.  From  these  orders  for  odd-number  of  members, 
the  optimum  even-number  orders  may  be 
obtained  by  a  simple  rule. 

In  C163#  Wherry  shows  that  Ross's  optimum  lists  are  not 
optimum  in  all  senses,  and  he  presented  an  empirically 
derived  list  for  seven  items  which  is  superior  to  the  list 
given  by  Ross  C1B3.  Also,  a  method  is  given,  whereby  any 
list,  arrived  at  either  rationally  or  empirically,  may  be 
rewritten  in  8n  different  ways,  by  use  of  4  step  given  in 
C163.  It  is  shown  that  2n  of  these  lists  may  be  combined  in 
such  a  fashion  that  fatigue  effects  are  cancelled  out. 


4.  -ANALYTICAL  PROCEDURES 


The  complete'  form  of  the  law  of  comparative  judgment 

(LCJ)  is 

ik7  ui-.?vlj(r'+^-ar^(rK<riV/2  us) 


An  experimental  test  of  the  complete  LCJ  has  not  been 
conducted  because  of  the  problems  encountered  in  determining 
values  for  the  unknowns*  standard  deviation  and  the 
correlation  coefficient  between  pairs  C12D.  Simplifying 
assuptions  are  usually  made  to  reduce  these  difficulties  (see 
section  3  )•  The  model  more  widely  employed  is  Thurstone's 
case  V  (r(k*j)*=0  and  ).  Case  V  assumes  that  one  can 
ignore  the  standard  deviation  associated  with  individual 
stimuli  because  they  are  constant  and  their  discriminal 
processes  are  uncorrelated.  That  is*  knowing  the  occurrence 
of  a  discriminal  process  from  one  distribution  would  not  help 
us  predict  the  discriminal  process  from  another.  Because  for 
our  case  'the  stimuli  are  complex  the  best  fit  for  our 
observational  data  is  necessary.  We  select  case  IV  for  the 
fitting  of  our  observational  data  and  propose  a  method  based 
on  the  solution  of  the  complete  form  of  the  LCJ  which  has 
less  restrited  assumption  that  case  IV.  Before  describing 
Case  IV  and  our  proposed  method*  we  describe  how  the 
observational  data  is  rearrange  to  be  used  by  either  method. 


After  each  of  the  n(n-l)/2  pairs  of  stimuli  have  been 

presented  a  large  number  of  times#  we  have  as  raw  data  the 

number  of  times  each  stimulus  was  judged  greater  than  each 
other  stimulus.  These  observed  frequencies  may  be  arranged 

in  the  n  x  n  squared  matrix  R.  The  general  element  r(j#  k)  # 

/ 

which  appears  at  the  intersection  of  the  jth  row  and  kth 
column#  denotes  the  observed  number  of  times  stimulus  k  was 
judged  greater  than  stimulus  j.  The  diagonal  cells  of  matrix 
R  will  ordinarily  be  left  vacant.  No  comparisons  are  made 

between  the  same  stimulus.  Since  the  symmetric  cells  (e.g.» 

r(2#3)  and  r (3, 2) )  sum  to  the  total  number  of  judgments  made# 
the  matrix  contains  n(n-l)/2  independent  cells. 

Lets  construct  matrix  P  from  matrix  R.  The  element 
p(j»k)  is  obtained  by  dividing  the  element  r(j,k>  by  the 
number  of  total  observation#  and  it  is  the  observed 

proportion  of  times  stimulus  k  was  judged  greater  than 
stimulus  j.  Diagonal  cells  are  #  again#  ordinarily  left 
vacant.  Symmetric  cells  now  sum  to  unity  (e.g.#  p(2»3> 
p  (3#  2 )  =1  > .  * 

After  the  matrix  P  is  constructed#  the  basic 
transf ormation  matrix  # X#  is  constructed.  The  element  x(j#k) 
is  the  unit  normal  deviate  corresponding  to  the  element 
p(j#k>»  and  may  be  obtained  by  referring  to  a  table  of  areas 
under  the  unit  normal  curve.  The  element  x(j,k)  will  be 


positive  for  all  values  of  p(j,  k>  over  0.  50,  and  negative  for 
all  values  of  p(j,k>  under  0.50.  Proportions  of  1.00  and 
0.00  cannot  be  used  since  the  x  values  c orr esp ond ing j to  these 
proportions  are  unboundedly  large.  When  such  proportions 
occur,  the  corresponding  cells  in  matrix  X  are  left  vacant. 
Zeros  are  entered  in  the  diagonal  cells  since  we  can 
ordinarily  assume  that  here  [f(k)-(J(j)  =  0.  The  matrix  is 
skew-symmetric:  that  is.  the  symmetric  elements  sum  to  zero, 
since,  e.  g.  .  x(2,3)=  -  x(3,2). 

Matrix  X  contains  the  sample  estimates  x(j,k)  of  the 
theoretical  values  found  in  the  equation  of  the  law  of 
comparative  judgment.  The  element  x(j.k)  is  an  estimates  of 
the  difference  C  Li<  k  >  — Vi<  J  >  )  between  scale  values  of  the  two 
stimuli  measured  in  units  of  the  standard  deviation  of  the 
distribution  of  discriminal  differences  ..  Each  independent 
element  of  matrix^  X  is  an  estimate  of  a  value  for  one 
equation  of  the  law. 

In  case  IV  of  the  LCJ.  the  assumptions  are  that  the 
discriminal  dispersion  are  not  subject  to  gross  variation  and 
the  correlation  term  is  zero.  Assuming  these  two 
conditions, a  linear  equation  is  obtained  (see  section  3). 
The  equation  is 


(<r„+r^  HO 


Togerson  C43  demonstrated  «hat  the  explicit  assumption  of 
zero  correlation  was  unnecessarily  restricting.  He  got  the 
same  result  as  Thurstone  assuming  the  correlation  £erm  equals 
for  each  pair  of  comparation  and  small  difference  between 
discriminal  dispersion.  The  approximate  equation  is 

2ti(lv-v-Vai/a(fk4(T(^  (ny 

where  equation  16  and  17  are  equal  if  the  correlation  term  is 
equal  to  zero. 

Two  method  have  been  presented  in  the  literature  for  the 
solution  of  Case  IV.  The  first  method  was  proposed  by 
Thurstone  C181.  In  this  methodi  the  standard  deviation  must 
be  estimated  from  the  observational  data  and  then  the  means 
ere  calculated.  Burros  C193  presented  an  alternative 
approximation  formula  for  the  estimation  of  the  standard 
deviation.  This  approximation  yields  the  same  value  of 
standard  deviation  as  Thurstone *%  method#  and  involves  less 
labor  calculation.  The  second  method  is  proposed  by  Gibson 
C203.  His  method  consists  of  a  least-square  solution  for 
case  IV.  He  displayed  case  IV  as  a  system  of  homogeneous 
linear  equations  for  which  a  least-square  solution  is 
presented#  using  various  conditional  equation  which  fix  the 
origin  and  the  unit  of  measurement.  However#  the 
computational  labor  that  would  be  involved  in  obtaining  a 
numerical  solution  is  such  that  it  has  not  yet  been  applied 


to  data. 


Method  A 

This  method  estimates  the  standard  deviation  using 

0 

“  BJVk  ~  i-  C '&) 

where 

09^ 

v«.  tuZHiK-fe^yf'/n 

Using  the  values  obtained  for  the  standard  deviation#  the 
scale  values  (means)  of  the  stimuli,  may  be  obtained  as 
f ol lows 

flUK=  (<rKlzjK K»(V-'N)  120) 

•!=« 

/ 

where  the  Constant  A  is  an  unknown  stretching  factor.  This 
constant  may  be  equal  to  the  square  root  of  2  (Thurstone)  # 
may  be  equally  to  unity#  some  larger  value#  or  equal  to 
SGRT(2/< 1-r ) )  C43.  See  references  C18#4#193  for  a  complete 

derivation  of  the  method  A  equations. 


Method  B 


In  this  method*  the  scaling  (means)  and  standard 
deviation  are  obtained  by  solving  a  system  of.  linear 


equations.  Lets  write  the  equations  for  a  four  stimuli 
comparation  as  follows: 

UL1-U2  OTt &■>.)  la 

U,-Ui -- 2,3 

Uv-Ua  :  Id 

Ui.U3-.22j  £Tt45jMG 
IU-U4  --2h  (T,.KJV)|f2  ■ 

Uj-Ua  -in 


These  equations  constitute  a  set  of  six  linearly  independent 
homogeneous  linear  equations  in  eight  unknowns.  Lets 
arbitrarily  select  a  zero  point  and  the  unit  of  measurement 
as  follows: 

v.  Ui  =  0 

and 

GY*  1  .  (23} 

Lets  substitute  equations  22  and  23  into  equation  21.  We  get 
the  following  set  of  six  linear  equations  in  six  unknowns: 

-U*.- 2i40i)(i  =.2, life 

-  U3  |ff'  =2,3/*g 

.U4-*,4difs  z,*  nr 

-  Uj  -  Hu  folii  -ZjjSJ/J?  -  O 

.U4-2m<&|{£-2m(SJ6-=0 

Ui-U4-Z«6U£  -ZwSHi  =0 


Solving  equation  C243i  a  unique  solution!  except  for  the 

/ 

origin  and  the  unit  of  measurement!  is  possible  with  four 
stimuli!  while  an  overdetermined  solution  will  be  .available 

T 

for  more  than  four  stimuli.  In  matrix  formi  equation  24  can 


be  stated  as  follows: 


-lOO  -?l2|r2  o  O  \ 

°  -l  0  0  -  2,3) ft  0 

0  0  0  0  -M& 

l  -I  0  -2zj|f£  O 

I  0  -\  0  -?2fllr2 

o  1  -1  0  jfym 


Since  A  is  square  for  four  stimuli/  the  unique  solution  is 

B  -  K'  C  ,  UO 

For  more  than  four  stimuli!  a  solution  for  equation  24  can  be 
obtained  fhom 

B-  (ATAT  AT  C  .  fcD 

Equation  27  is  a  least-square  solution  in  the  sense  that  the 
means  and  the  standard  deviation  minimize  the  sum  of  the 


squared  discrepancies  of  the  entries  in  the  matrix  product 


AB»  from  the  corresponding  entries  in  C. 


If  equations  22  and  23  are  replaced  by  equation  28  and 

T 

29,  one  obtains  a  greater  degree  of  symmetry  which  will 
involve  more  of  the  unkowns  in  each  of  the  observation 
equations. 

X  Uv  -  0  lib 

C'-\ 

and 

U> 

Lets  multiply  equation  29  by  l/sqrt<2>  i<j.k)  to  obtain 


Adding  equation  28  and  the  appropriate  equation  30  to  each 
equations  21  for  five  stimuli  in  matrix  form: 


* 0 1  "  o  o  tuifx  ailfi 
2  •  o  1 1  o  inir,  o  a,,ir2  2uia 

2  M  0  1.  0  u\fi  o 

2  II  I  o  o  2,51(2  2, sift  2|S|I5  o 

I  j  o  I  *  2»Nt  0  O  2«|(z  Zajli- 

I  1  I  0  I  O  2j*|(5  0  2w|f: 

I  2  It  0  Zislfj  O,  2,51(1  2»slifi  0,_ 

i  I  12  0  1  2*0  (fl  O  0  Zwlfii 

\  *  I  2  I  0  ?ssliT  2>dfi  o  ...  2«lfl  O 

\  I  I  I  2.  0  2«f(l  ajjjft  2,5 1 fi.  o  o 
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t'Uwlfe 
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For  five  stimuli  the  solution  to  equation  31  is 

T  -  V'  .  1*0 

For  more  than  ^ive  the  solution  to  equation  31  is 

.  u i) 

In  method  B«  the  computational  load  is  quite  heavy  but  this 
solution  has  the  advantage  of  providing  the  best-fitting  mean 
(ranking)  and  standard  deviation  values  for  a  set  ,  of 
paired-compar ison  data. 

If  the  stimuli  compared  are  very  complex.  the 

assumptions  for  case  IV  are  not  valid  and  the  solution 
obtained  will  not  be  the  best-fitting  mean  and  discriminal 
dispersion  for  the  observa t ional  data.  Maybe  the  best 
solution  will  be  the  use  of  the  complete  form  of  the  LCJ. 
Until  now.  an  experimental  test  of  the  complete  form  of  the 
LCJ  has  not  been  conducted  because  of  the  problems 

encountered  in  determining  values  for  the  unknowns 

<  UvC)  ^  Y\.  ^  C123.  Lets  now  present  a  method 

of  getting  a  solution  based  on  least-squares  for  the  complete 
form  of  the  LCJ  assuming  the  correlation  term  to  be  constant 
(Method  C).  Equation  34  shows  this. 

✓U*  -  Uj  =  ■Zvcs  (a-*  +  l  34) 

zKi  »(uK  -viO/  +«rJ1-2t-<rK(Tj')/4.  t*s) 


or 


where  equation  35  is  a  nonlinear  equation, 
equation  35  as 


Lets  rewrite 


f  C  x ) = (Uk  -  UiVCoi* zr  <rK  q-)'4  \it) 

"her'  5i(-.«l,r) 

Apply  a  Taylor  expansion  to  equation  36  and  use  the  first  two 
terms  of  the  series. 


which  in  matrix  form  is# 


K  s  A  V  w* 

where  R  is  a  matrix  which  each  element  is  given  by  the 
difference  x(k.j)  -  f(X<>  ).  The  siie  of  this  matrix  is 

n(n-l)/2  rows  by  1  column.  A  is  a  matrix  where  each  element 
is  a  partial  derivative  of  the  function  f(  X  )  evaluated  for 
*c .  The  size  of  this  matrix  is  ntn-l>/2  rows  by  2n+l 


columns. 


Y  is  a  matrix  of  the  unknown  variables  minus  the 


initial  condition  X0.  The  size  of  the  matrix  is  2n  f  i  rows 
by  1  column.  Multiply  both  side  of  equation  39  by  the 

*  t: 

transpose  of  matrix  A  (A'). 

A'  R  --  A'  f\Y  UA 

.  / 

Equation  40  is  a  least  squares  solution  (see  appendix  B). 

If  equation  40  is  multiply  by  (A'A)  »  then  we  obtain 

\=  (a'a)'a'r  wo 

but 

then 

x=  y+Xc 

The  first  N  elements  of  the  X  are  our  scaling  or  ranking  of 
the  N~stimulos. 

In  the  next  section*  the  computer  implementation  for 
method  A  is  presented. 


5. -COMPUTER  IMPLEMENTATION 


This  section  presents  the  algorithm  us-ed  for  the 
implementation  of  method  A  presented  as  the  solution  for  case 

IV  of  the  law  of  comparative  judgment  (LCJ).  Methods  B  and 

/ 

C  have  not  been  implemented  yet.  In  this  section>  u»e  mill 
propose  an  algorithm  for  both  methods. 

METHOD  A 

This  method  is  implemented  using  the  subroutine 
TCIV.  Given  as  an  input  the  basic  transf ormation  matrix  X 
which  each  element  is  the  normal  deviate  corresponding  to  the 
proportion  of  empirical  judgment  j >k«  and  the  total  number  of 
stimulis  used  N#  the  algorithm  used  to  construct  this 
subroutine  is  as  follows; 

a)  Sum  each  column  of  matrix  X 

SXOOs-2  >,2, ...... 

i 

b)  Sum  the  square  of  each  element  of  matrix  X 

SQXlKS*£zj£  II. 

3 


by  column 


c)  Multiply  the  sum  of  the  squares  by  the 


total  number  of  stimuli  by  column 


SQXMUW 


d)  Square  the  sum  of  each  column  of  matrix  X 


by  column 


e)  The  square  root  of  the  difference  of  step 
c  and  d  is  obtained  by  column 


'4 


XN #  (  SQXNltf)  - SQSX mb . 


f)  The  inverse  of  step  e  is 


obtained  by  column 


xixnv  Crt  ^  i/'xNvco. 


i* 

g)  The  sum  of  the  inverse  of  step 


obtained 


K 


is 


h)  XN3  is  obtained 


xnb  2m|sumxwv. 


i)  The  standard  deviation  is  now 


obtained  by 


col umn 

<TCKl  XNfciXXHVW-i,- 


/ 

j)  Check  if  the  sum  of  standard  deviations  are 


equal  to  N 

K 


k)  In  this  step  the  sum  of  the  elements  of 
matrix  X  by  row  is  obtained 

K 


1)  Multiply  each  result  .of  step  k  by  the 
corresponding  discriminal  dispersion 


sxRxib^SRxU'i  *<rti:V 


a)  Multiply  step  a  by  the  discriminal 

dispersion 


sxsx  no  $  sx^  *<r«o. 


n)  The  difference  Of  step  a  and  step  1  is 


obtained 


Xs  M  4-  SXSK  i.K\ -SWX  (A. 

o)  Divide  XS(k)  by  the  total  number  of  stimuli 

/ 

and  the  scaling  for  each  stimuli  is  obtained. 

X$(k\/v. 

p)  Check  for  the  sum  of  the  scaling 

o. 

k 

METHOD  B 

Like  method  A #  the  inputs  are  matrix  X  and  a 
variable  N.  The  algorithm  is  as  follows: 

a)  Create  matrix  E  and  0. 

\' 

b)  Check  for  the  number  of  stimuli  N. 

1)  If  n  is  less  than  5  etop. 

2)  If  N  is  no  equal  5  go  to  step  c 


3)  else 


1-  Get  the  inverse  pi  matrix  E. 

2-  Multiply  the  inverse  of 

/ 

matrix  E  J by  matrix  G. 

3-  Matrix  F  will  contain  the 

ranking  and  the  standard 

deviation. 

4-  Go  to  step  h. 

c) .  Get  the  transpose  of  E  <E'>. 

d)  Multiply  matrix  E *  by  E  and  matrix  E '  by  G. 

»'• 

e)  Get  the  inverse  of  the  multiplication  of 

matrix  E'  by  E. 

if  Multiply  the  results  of  step  e  by  the 
results  obtained  in  step  d  for  the  multiplication  of  matrix 
E'  by  G. 


g)  The  results  of  step  f  is  the  matrix  F  that 


contains  the  ranking  and  standard  deviation. 

T 

h)  Check  if  the  sum  of  the  first  N  elements  of 

the  matrix  F  are  equal  to  zero*  and  the  sum  of  the  last  N 

/ 

elements  are  equal  to  N. 

i)  Stop. 


METHOD  C 


Like  the  other  two  methods*  the  input  will  be  the 
matrix  X  and  the  total  number  of  stimuli  N.  This  method 
needs  an  initial  condition.  The  result  obtained  from  method 
A  or  method  B  can  be  used  as  initial  condition.  If  method  A 
is  used*  the  initial  condition  for  the  correlation  term  is 
set  to  negative  one.  For  method  B#  it  is  set  to  zero.  The 
algorithm  is  as  follows: 

a)  Construct  matrix  A  and  matrix  R. 

b) .  Find  the  transpose  of  matrix  A  (AS. 

c)  Find  the  inverse  of  the  product  A 'A. 


i 


d)  Multiply  the  transpose  A'  by  R. 


e)  Multiply  the  results  of  step  c  by  step  d. 

f)  Check  the  elements  of  the  matrix  resulting 

» 

from  step  e.  If  all  the  elements  are  less  than  a  giving 
accuracy  go  to  g  else  go  to  h. 

g)  The  results  is  the  sum  of  the  results  of 
step  e  plus  the  initial  condition.  Stop. 

h) Sum  the  results  of  step  e  plus  the  initial 
condition.  This  result  mil  be  the  new  initial  condition. 
Go  to  a. 

In  appendix  C«  the  listing  of  the. program  for  method  A 
is  presented. 


6.  -RESULTS 


This  section  presents  the  results  obtained  for  two  given  data 
sets.  The  two  data  sets  were  obtained  from' ref erences 
C4*  183.  The  results  obtained  by  our  program  are  compared 
with  the  results  already  published  in  references  C4, 183. 

The  first  data  set  were  taken  from  reference  C43.  Table  1 

-  t 

shows  the  data  set.  The  results  given  by  Torgerson  E43  are 
showed  in  table  2.  Table  3  shows  our  results*  which  agree 
with  the  results  given  in  table  2. 

Matrix  X 

Stimuli  k 


l 

2 

3 

4 

5 

1 

0.0000 

0.2778 

0.6818 

1.2500 

1,2500 

2 

-0.2776 

0.0000 

0.5000 

I.07J4 

1.1 364 

Stimuli  J  3 

-0.6818 

-0.5000 

0.0000 

0.2778 

0,3769 

4 

-I.2JOO 

-1.07)4 

-0,2778 

O.QOOO 

0.5000 

3 

-1.2300 

-1.1364 

-0.5769 

-0.5000 

0,0000 

Table  1. 

Data  Set  Given  by  Torgerson  (4j 

for  his  Illustrative  Example. 

Stimuli 

1 

2 

3 

4 

3 

STO.  0ev. 

1.0634 

0.8490 

1.2165 

0.5856 

1.2854 

SCALING 

-1.417 

-0.893 

0.129 

0.633 

1.548 

Table  2.  Results  Given  by  Torgerson  (A}  , 


MATR I X 


X 


0.  0000 
-0.  P.778 
“0.  6818 
-1.  2500 
-1.  2500 


0/  2778 
0.  0000 
-0.  5000 
-1.  0714 
-1. 1364 


STD. 

STD. 

STD. 

STD. 

STD. 


0.  6818 
0.  5000 
0.  0000 
-0.  27  /8 
-0.  5769 


1.  P500 
1 .  07 1 4 
0.  2778 
0.  0000 
-0.  5000 


I .  2500 

J .  1 364 
0.  5769 
0.  5000 
0.  0000 


DEV. 

( 

i  ?- 

1 . 063384 

DEV. 

( 

2  >  = 

0.  849030 

DEV. 

( 

3  >- 

1. 216482 

DEV. 

< 

'  .  '<  ~ 

0.  585535 

DEV. 

( 

5  ?  “ 

.1 . 285470 

SCALING 

( 

1  )  T— 

-i.  416595 

SCALING 

( 

;?>■- 

-0.  872860 

SCALING 

( 

CO- 

0.  J  2864 1 

SCALING 

( 

4  )■■ 

0  632680 

SCALING 

( 

T>  >  — 

1 . 543135 

Table  3.  Results  Obtained  by  our  Program  TCIV. 


1 


The  second  data  set  were  taken  from  reference  £183.  These 

data  were  obtained  exper imental ly  by  Thurstone.  These  data 

consists  of  thirteen  nationalities  or  races.  Each  one  of 

this  nationality  was  paired  with  every  other  nationality. 

The  number  of  pair  was  78.  These  pairs  were  arranged  in  a 

✓ 
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printed  schedule  and  were  submitted  to  250  high  school 
children  in  Chicago.  The  instruction  uere  given  with  the 
following  printed  schedule. 

This  is  an  experimental  study  of  attitudes  toward  races 
and  national ities.  You  are  asked  merely  to  underline  the 
one  nationality!  or  race.  of  each  pair  that  you  would 
rather  associate  with.  For  example!  the  first  pair  is: 

ENGLISHMAN  -  SOUTH  AMERICANS 
If  in  generali  you  prefer  to  associate  with  ENGLISHMAN 
rather  than  with  SOUTH  AMERICANS!  underline  ENGLISHMAN. 

If  you  prefer!  in  general!  to  associate  with  SOUTH 
AMERICANS,  underline  SOUTH  AMERICANS.  If  you  find  it 
difficult  to  decide  for  any  pair,  simply  underline  one 
of  them  anyway.  If  two  national ities  are  about  equally 
well  liked,  they  will  have  about  the  same  number  of 
underlinings  in  all  of  the  papers.  Be  sure  to  underline 
one  of  each  pair  even  if  you  have  to  make  a  sort  of 
guess.' 


Table  4  shows  the  experimental  proportion.  It  shows  the 
proportion  of  the  subjects  who  preferred  each  nationality  at 
the  top  of  the  table,  to  each  nationality  at  the  side  of  the 
table.  For  example,  the  proportion  of  subjects  who  preferred 
ENGLISHMAN’  to  SOUTH  AMERICANS  was  .935.  The  proportion  of 
subjects  who  preferred  SOUTH  AMERICANS  to  ENGLISHMAN  was 
.065*  since  intermediate  categories  of  judgment  were  not 
allowed.  Table  5  shows  the  X-vaiuesi  and  Table  6  shows  the 
results  fof  the  standard  deviation  and  the  scaling  value  for 
each  nationality.  Table  7  shows  the  results  obtained  by  our 
program.  The  standard  deviation  results  agree  with  table  6. 
The  scaling  results  are  different,  because  our  stretching 
factor  A  is  equal  to  one.  If  one  divides  our  scaling  results 
by  1/U2.  A=1/US.  one  obtains  the  same  results  as  table  6. 


Experimental  Proportions 


1 

Ed*. 

2 

Ct. 

i 

Ft. 

4 

It. 

5 

Sc. 

n 

J 

Ge. 

• 

Ho. 

l 

10 

Be. 

17 

Jew 

11 

It. 

1 . 

Eng. 

.218 

.324 

.165 

.221 

.227 

.162 

.144 

.103 

.065 

.155 

.066 

2 . 

C*. 

.612 

life 

.457 

.406 

BjH 

.260 

.297 

.102 

.201 

.100 

.088 

.180 

.073 

3 . 

Fr. 

.782 

. 

.541 

.370 

SEE 

.255 

.184 

.214 

.149 

.192 

.081 

4 . 

Ir. 

.676 

.594 

.459 

.361 

.387 

.378 

.253 

.273 

.243 

.162 

.221 

.128 

5 . 

Sc. 

.835 

mm 

.500 

.639 

.... 

.400 

.409 

.268 

.249 

.258 

.262 

.223 

.128 

6 . 

Sw. 

.779 

EH 

EE 

.613 

.600 

.471 

.444 

.377 

.317 

.318 

.229 

.228 

7 . 

Gt. 

.773 

.703 

.620 

.622 

.591 

.529 

.... 

.347 

.391 

.325 

.345 

.253 

.152 

8 . 

Ho. 

.838 

.898 

.745 

.747 

.732 

.556 

.653 

.471 

.432 

.389 

.263 

.310 

9 . 

Sp. 

.856 

.799 

.816 

.727 

.751 

.623 

EE 

.529 

EE 

.422 

.289 

.217 

10 . 

Be. 

.897 

ICXi] 

.786 

.757 

.742 

.683 

.675 

.568 

.490 

.461 

EE 

.271 

11 . 

S.A. 

.935 

.912 

.851 

.838 

.738 

.682 

.655 

.611 

.578 

.539 

Kko 

.320 

12 . 

Jew 

.845 

EH 

EE 

B3 

.777 

.771 

.747 

.737 

.711 

EE 

EE 

.524 

13 . 

It. 

.934 

.927 

.919 

.872 

.872 

.772 

.848 

.690 

.729 

.680 

.476 

.... 

Table  A.  Experimental  Proportion  Given  by 
Thurstone  as). 


X-Values 


i 

Eo,. 

1 

c». 

1 

Fr. 

H 

3 

Sc. 

« 

Sw. 

» 

G«. 

I 

H*. 

» 

Sp. 

10 

Be. 

n 

u 

Jew 

u 

IL 

1  Eng..,. 

.00 

-  .28 

-  .78 

-  .46 

-  .97 

-.77 

-  .75 

-  .99 

RW  <■ 

-1.51 

-1.02 

-  1.51 

2  C» . 

.28 

.00 

-  .11 

-  .24 

-  .58 

-.61 

-  .53 

-1.27 

-  .84 

U  R'  *1 

-1.35 

-  .92 

-  1,45 

3  Fr . 

.76 

.11 

.00 

.10 

.00 

-.33 

-  .31 

-  .66 

*  ^"1 

-  .79 

-1.04 

-  ,87 

-  1.40 

4  Jr . 

.46 

.24 

-  .10 

.00 

—  ,36 

-.29 

-  .31 

-  ,67 

SHE 1 

-  .70 

-  .99 

-  .77 

-  1.14 

5  Sc . 

.97 

.58 

.00 

.36 

.00 

-.25 

-  .23] 

-  .62 

-  .63 

-  .65 

-  .64 

-  .76 

-  1.14 

6  Sw . 

.77 

.64 

.33 

.29 

.25 

.00 

-  .07 

-  .14 

-  .31 

-  .48 

-  .47 

-  .74 

-  .75 

7  Ge.... 

.75 

.53 

.31 

.31 

.23 

.07 

.00 

-  .39 

-  .28 

-  .45 

-  .40 

-  .67 

-  1.03 

8  Ho.... 

.99 

1.27 

.66 

.67 

.62 

.14 

.39 

.00 

-  .07 

-  .17 

-  .28 

-  .63 

-  .50 

9  So . 

1.06 

.84 

.60 

.6S 

.31 

.28 

.07 

.00 

.03 

-  .20 

-  .56 

-  .78 

1.26 

1.28 

.79 

.70 

.65 

.48 

.45 

.17 

-  .03 

.00 

-  .10 

-  .36 

-  .61 

11  S.A.. , . 

1.51 

1.35 

1.04 

.99 

.64 

.47 

.40 

.28 

.20 

.10 

.00 

-  .20 

-  .17 

12  lew.... 

1.02 

.92 

.87 

.77 

.76 

.74 

.67 

.63 

.56 

.36 

.20 

.00 

.06 

13  li . 

1.51 

1.45 

1.40 

1.14 

1.14 

.75 

1.05 

.50 

.78 

.61 

.47 

-  .06 

.00 

Table  5.  X- Values  given  by  Thurstone  (18). 


Stolid 

S.D. 

1  English . 

1.4050- 

1.3121 

2  Canadian . 

.8718 

,8295 

3  French . 

.4902 

.7062 

4  Irish . 

.6159 

1.1791 

5  Scotch . 

.2828 

.7015 

6  Swede . 

.1029 

1.0837 

7  German . . 

.1298 

1.0122 

8  Hollander . 

-  .2573 

.7634 

9  Spaniard . 

-  .2805. 

.8224 

10  Belgian . 

-  .4229 

.7646 

11  South  American.... 

-  .5686 

.7170 

12  Jew . 

-1.2540 

2.1167 

13  Italian . 

-1.1151 

.9918 

Table  6.  Results  Given  by  Thurstone  • 


STD. 

DEV. 

<  1  >  = 

.1.  3.12225 

STD. 

DEV. 

(  2;- 

O. 029539 

STD. 

DEV. 

(  3>- 

O.  705908 

SID. 

DEV. 

(  4>  = 

J.  17926'! 

STD. 

DEV. 

(  5  >  = 

O.  7014  J  J 

STD. 

DEV. 

(  6>  = 

).  004  J  '19 

STD. 

DEV. 

(  7?  = 

t.  012095 

STD. 

DEV. 

i.  S )  - 

0  763' 06 

STD. 

DEV. 

(  9;- 

S2 17  D2 

STD. 

DEV. 

•.  iO>  = 

0.  764467 

STD. 

DEV. 

(11)  = 

0.  71660'! 

STD. 

DEV. 

<  12)  = 

if.  1176'!? 

STD. 

DEV. 

(13)  = 

0.  991697 

SCALING 

( 

1  ):- 

1.  V2737 5 

SCALING 

( 

el  )  55 

1 . 303057 

SCALING 

( 

3)  = 

0.  672133 

SCALING 

< 

4 )  = 

0.  3/J243 

SCALING 

( 

5)  = 

0.  379926 

SCALING 

( 

6 )  = 

0.  .14  5385 

SCALING- 

< 

7 )  = 

0.  J  33501 

SCALING 

( 

S)  = 

-0.  363354 

SCALING 

( 

9 )  = 

-0.  396541 

SCALING 

( 10)  = 

-0.  598002 

SCALING 

(11)  = 

-0.  804074 

SCALING 

( 1 

2 )  = 

-1.  774290 

SCALING 

<  1 

3 )  = 

-J.  577064 

Table  7.  Results  Obtained  by  our  Program  TCIV. 
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APPENDIX  A 


In  this  appendix*  the  standard  deviation  of  the 
difference  between  two  normal  random  variables  is  found. 

/ 

Assume  that  X  and  Y  are  two  normal  random  variables. 
The  expected  value  can  be  written  as  follows: 

E[(x-vf]-  E  1.x1- 2XY+Y1]  10 

=  X1  -2xV  +  Y*  . 

The  variance  for  a  random  variable  is  defined  as 

O’x2 

•-  ElVJ-2Ux£lx]  +  Ux 

Git*  =.  X*  -  M,1 ,  IS) 

i'* 

Using  the  same  procedure* 

0^  t-  Yl  Uy  •  E4) 

If  one  substitutes  into  equation  (2)  with  <3)  and  (4)  then* 

e[(x-Y)2]=  <Txl+qJ  +  (TYl+U^-2W 

-  Cl*  +<Ty  +Ux  +Uy  -  ZVj.  15) 


The  last  term  in  equation  (5)  is  the  correlation  term  and  can 
be  defined  as 

Elxyl  -  x?. 

If  X  and  Y  have  nonzero  means#  then  it  is  frequently  more 
convenient  to  find  the  correlation  by  substracting  the  mean 
values. 

e\.(X-Ux'S  W-UyS]  =  (x-U*>  CY-Uy) 

This  is  known  as  the  covariance. 

To  express  the  degree  to  which  two  random  variables  are 
correlated  without  regard  to  the  magnitude  of  either  one# 
then  the  correlation  coefficient  or  normalized  covariance  is 
the  appropriate  quantity.  It  is  defined  as 

S=  x-u*  "t  =  Y-’iy 

"  os  sr~ 

+  V  =  *t ) 

hence 

XY  =  eIxy]  * 

-  E[st]OiCy  f  E  t  U-MOUy']  +  e[(M  -UyiU*"]  *  E  Wxl 

*  PfliSy  +  E[kUy-My]+  E[YUx  -UyU|<]  vEUlyUx] 

=•  ?0k5y  +  UxUy -UxUv  +■  Uy  UicUyUi#  +l/y(/y 

XY  =  f(Tx«V  +  UxUv  •  U> 


Substitute  equation  (6 )  into  equation  (5) 

eUx-y/J  =  <Tx1+iy'+^t+'  Uv  -2(jii«V  *Wr>- 

*  «x +«v  -  25>(Tx^  +Ux-  flUxUY  tU* . 

/ 

The  last  three  terms  are  just  The  square  of  The  mean  of 
(X-Y).  Then* 

*  SxVffV*-  2Jt.«V  +  (  «» -«y  >* 

=  flk'+cj  -2$«vcv  4  (e  U-Yif . 

In  general 

cr1  =  x1-  M*  >  M 

and  from  equation  <7)» 

(S^+Uy  -2j>fix<fySEt(x-Y>l]*(E&<-V]t. 

Comparing  equations  <8>  and  <9h  the  left  hand  term  is  the 
variance  for  the  substraction  of  two  random  variables. 

5iv  =  . 

The  standard  deviation  is  the  square  root  of  the  variance1. 

,  fa 

Cty  »  { 4  (Ty  -  2?Si«y)  -  t  lo) 


Then- 


APPENDIX  B 


In  this  appendix*  it  is  demonstrated  that  A 
implies  a  least  square  solution 


If 


or 


where  is  an  error  term. 


f\ 
-  txj 


In  matrix  form 


?*)  -  ?Ki 


S  £ 


and 


tin*  ,  . .  •  -  *)  -  £ 


R=A 'AX 


APPENDIX  C 


TMDS  SUBROUTINE  TCIV 


LANGUAGE:  Fortran  VI I*  using  TMDS  subroutine!  for 

/ 

Perkin-EImer  8/32. 


PURPOSE  :  To  rank  the  relative  visual  differences  among 
a  set  of  texture  pairs. 


INPUT/OUTPUT:  Respectively*  the  samples  estimates 

x<j.k>  contained  in  a  matrix  X* 
a  single  interger  value  which 
represents  the  total  number  of 
texture  pairs  and  the  standard 
deviation  ofeach  texture  pairs. 


»'• 

USAGE  :  CALL  TCIV  (X*  SCALE*  SIGMA.  N) 


X  -  input  the  samples  estimates 


SCALE  -  output  ranking  of  texture  pairs. 


SIGMA  -  output  discriminal  dispersion  of 

texture  pair. 


N  -  input  total  number  of  texture  pairs. 


PROGRAM  LOGIC  :  The  rank  of  the  relative  differences 
among  a  set  of  texture  pairs  is  calculated  using  case  IV  of 
the  LCJ.  The  standard  deviation  is  calculated  using 


GV  a.  B/Vk  -1 

tU2V/|Vl/*  t 
V*  =1  Ul*lK  - 


The  scale  value  of  the  texture  pair 


is 


calculated  using 


r*  H 

A  lie  S  (^K  IjiK  +  ]n  K  . H 


where  A»  1  and  correspond  to  a  correlation  of  r=  -1. 


TLENAME  =  LSU1 :  TC IV.  FTN 


*  1  C 

2  C 

3  C 

4  C 

5  C 

6  C 

7  C 

a  c 

«?  c 

10  c 

11  c 

12  C 

13  C 

14  C 

15  C 

16  C 

17  C 

18  C 

1?  C 

20  C 

21  C 

22  C 

23  C 

•-  ’24  C 

.  25  C 

26  C 

27  C 

28  C 

29  C 

30  C 

31  C 

32  C 

•  33  C 

34  C 

39  C 

36  C 

37  C 

38  C 

39  C 

40  C 

41  C 

42  C 

43  C 

44  C 

45  C 

46  C 

47  C 

48  C 

49  C 

50  C 

51  C 

*  52  C 

53  C 

54  C 

*  55  C 

56  C 


TEXTURE  MEASUREMENT  DEFINITION  SYSTEM 
REMOTE  SENSING  AND  IMAGE  PROCESSING  LABORATORY 
ELECTRICAL  AND  COMPUTER  ENGINEERING  DEPARTMENT 
LOUISIANA  STATE  UNIVERSITY.  BATON  ROUGE.  70803 


PROGRAM  TCIV 

PURPOSE 

TO  RANK  THE  RELATIVE  VISUAL  DIFFERENCE  AMONG  A  SET  OF  TEXTURE 
PAIRS. 

METHOD 

THURSTONES  CASE  IV  OF  THE  LAW  OF  COMPARATIVE  JUDGMENT. 

DESCRIPTION  OF  PARAMETERS 

X  -  BASIC  TRANSFORMATION  MATRIX.  EACH  ELEMENT  OF  THE  MATRIX 
IS  THE  NORMA  DEVIATE  CORRESPONDING  TO  THE  PROPORTION 
OF  EMPIRICAL  JUDGMENT  J  >  K.' 


SIGMA-  ONE  DIMENSION  ARRAY  CONTAINING  THE  DISCRIMINAL 
DISPERSIONS. 

SCALE-  ONE  DIMENSION  ARRAY  CONTAINING  THE  MEANS  OR  SCALE  VALUES 
N  -  TOTAL  NUMBER  OF  TEXTURES  PAIRS. 

REMARK 

THIS  PROGRAM  IMPLEMENT  THE  CASE  IV  OF  THE  LCJ.  THE  INPUT 
TO  THIS  PROGRAM  IS  THE  MATRIX  X  AND  THE  TOTAL  NUMBER  OF 
TEXTURE  PAIRS.  THE  OUTPUT  IS  THE  SCALING  AND  THE  DISCRIMINAL 
DISPERSION  OF  THE  TEXTURE  PAIRS. 


AUTHOR 


58 

C 

R.  E.  VASQUEZ-ESFINOSA 

S9 

C 

60 

C 

61 

C 

DATE 

62 

C 

63 

C 

SEPTEMBER  20,  1982 

64 

C 

65 

C 

66 

C 

REFERENCE 

67 

C 

/ 

68 

C 

THE  MEASUREMENT  OF  VALUES  BV  L.  L.  THURSTONE. 

69 

C 

70 

71 

C 

72 

SUBROUTINE  TCIV(X,  N.  SIGMA,  SCALE> 

73 

DIMENS ION  X ( N,  N > ,  SIGMA < N > ,  SCALE (N),  SUMXCOL ( 500 ) ,  SUMSQ ( 500 ) , 

74 

*VNK ( 500 ) ,  XINVNK ( 500  > 

75 

c 

SUM 

THE  ELEMENT  OF  EACH  COLUMMN  AND  KEEP  THE  RESULTS  BY  COLUMN 

76 

c 

SUM 

THE  SQUARE  OF  ELEMENT  OF  COLUMN  AND  KEEP  THE  RESULTS  BY  COLUMN 

77 

c 

78 

DO  10  K»1,N 

79 

SUMXCOL <K>=0.  0 

80 

SUMSQ (K>«0.  0 

-81 

DO  10  J=l,  N 

82 

SUMXCOL ( K ) “SUMXCOL ( K )  ♦  X<J,  K> 

83 

SUMSQ ( K ) =SUMSG ( K )  +  X(J,K)«*2 

84 

10 

CONTINUE 

85 

SINV=0.  0 

86 

DO  20  K-l.N 

87 

VNK(K)*SQRT<N*SUMSQ(K)  -  SUMXCOL <K>##2> 

88 

XINVNKCK)-  1.0/  VNK(K) 

89 

SINV*SINV  ♦  XINVNK(K) 

90 

20 

CONTINUE 

91 

XNB-  2.  Q*N/SINV 

92 

DO  30  K-l.N 

93 

SXGMA<K)»XNB»XINVNKOO  -1.0 

94 

30 

CONTINUE 

95 

c 

FIND  THE  SCALING 

96 

c 

LET 

97 

c 

98 

DO  40  K~1,N 

99 

SUMXCOL (K)-0.  0 

100 

* 

DO  50  U*1.N 

101 

SUMXCOL  OO -SUMXCOL <K>  4  X<U#K> 

102 

30 

CONTINUE 

103 

SUMXCOL CK) -SIGMA IK)  «  SUMXCOL(K) 

104 

40 

CONTINUE 

103 

DO  60  K«1*N 

106 

SUMSQ <K>-0.  0 

107 

DO  70  J-1'N 

108 

SUMSQ (K) "SUMSQ (K)  ♦  SIGMA< J)#X< J,  K) 

109 

70 

CONTINUE 

110 

SCALE! K)-<SUMXCOUK)  ♦  SUMSQ(K)  >/N 

111 

60 

CONTINUE 

112 

RETURN 

,  113 

END 

